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IMAGE CAPTURE CONTROL 



This patent application relates to techniques for acquiring images from a solid-state imager 
when exposure to the scene is controlled by either an asynchronous lighting strobe, or by the 
asynchronous opening of a shutter. The techniques that we describe do not require an electronic 
connection between the sttobe/shutter and the sensor in order to work, and are hence applicable 
for use in systems were there is a physical reason, or an electronic reason why this connection 
is not feasible. 



Background 

Solid state image sensors dominate electronic imaging applications such as CCTV, video cam- 
eras and camcorders, scanners, and are the basis of newly developed markets such as PC-cam- 
eras for vjdeoconferancing, medical vision, machine vision and Digital Stills Cameras. 

One popular form of image sensor is the Charge Coupled Device (CCD), whilst sensors built 
.entirely within standard CMOS processes are also gaining currency. Both have their relative 
merits "when applied to these techniques. 

In some systems it is desirable to seperate the operation of the sensor from the exposure mech- 
anism. One such appliaction is Electronic Film, for use in conventional Silver Halide Cameras 
such as 35mm SLR (Single Lens Reflex). Here the solid stale sensor replaces the chemical film 
within the camera, and as with chemical film the exposure is controlled by the shutter of the 
camera In order that such an Electronic Film can work without user modification of the camera 
to access the shutter control signal, or with older non-electronic cameras, it is necessary for 
the sensor to auto-deiect that it has been exposed. This system must offer a high probability of 
succesful detection , and be scene independent, working under the widest possible range of 
camera exposures, and additional operating conditions such as flash and fill-in flash. 

Another application is in medical vision and in machine vision, where exposure/, llurnination 
occurs through an illumination strobe, and there axe physical or electronic reasons why a syn- 
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chro'nisation pulse between the light source and the sensor can hot occur For example it may 
be necessary to isolate the light source from the detector for reasons of safety, as in an X-ray 
system. 



Summary of invention 

Figure 1 shows a general system incorporating a solid state image sensor with a shutter (elec- 
tronic, mechanical, or electromechanical), alighting stobe. and a detector. The shutter and/of 
the lighting stobe provide means of asynchronous stimulation of the image sensor The classic 
approach to the problem would be try to detect the asynchronous event and to then subsequent- 
ly instigate an exposure and acquisition sequence for the image sensor. The problem with this 
approach is that it puts design pressure on acheiving an asynchronous event detector that is suf- 
ficient^ fast and reliable, that the interaction between activating the image sensor and the asyn- 
chronous stimulus does not corrupt the effective exposure. Fig 2a shows a timing diagram of 
an image acquisition sequence where the detector triggers the release from reset of ihe array, 
putting it into inicgration, it is then read when the stimuli has gone away. In this example the 
solid state image sensor and the detector see the stimuli simultaneously, as in the case of a light- 
ing strobe. As- can be seen the time for the detector to trigger, Td f reduces the effective amount 
of the stimuli, Ts, to an amount Te, that js approximately equal to 
Te = Ts -Td 

If there is a spatial distance between the detector and the image plane of the solid state sensor 
with respect to the stimuli, as in the case of a blade shutter in an SLR camera then the Td can 
result in a gradiant of exposure across the array. Fig 2b shows an example of what would hap- 
pen to an array if the detector was located to the left hand side of the array, and the shutter was 
opening from the right hand side of the array. If Tsh 1 is the time the shutter takes to cross the 
array and Tsh2 is the subsequent time for the shutter to pass from the array to the detector, then 
as the diagram shows the two sides of the array see different effective stimuli, Tel and Te2, as 
defined by 

Tci =Ts -Td -Tshl-Tsh2 
Te2 « Ts -Td -Tsh2 

This problem can be reduced by using detectors on the side of the shutter that opens first, but 
nill if the time to detect Td is greater than the time to reach the array Tsh2, then there will be 
a gradiant of exposures across the array. The effective stimuli will be soemwhere between the 
following values 

0Ts-Tsh2) < Te < (Ts-Td), were Tsh2 > Td 

dependant on the position in the array. This is clearly undesirable 

We describe a more radical approach to the problem that greatly increases the probability of 
succesful detection oi the asynchronous event with no degredation of the stimuli. This ap- 
proach can be briefly described below:- 
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a) The image sensor is regularly reset, at a repetition rate of Tr. this is ^own as the ^tcct pe- 
riod In this period between the resets the image sensor is integrating any incident l.ght. 
b, If during a given detect period the detector has fired, indicating that there has been some 

liLll. o/ deration Ts„ then the next reset pulse is inhibited, and the sensor en- 
ters it's continued integration period . 

c) In the continued integration period. Tc. the integration of the array b ^J_ 
the exnnt of the longest asynchronous stimulation . Ts(max). Th>s may either be a fixed time or 
a time based on a trfgger by a detector that the stimuli has gone away. The sensor now enters 

dTr^Ae^^« p«-«* t». *« is readoul - and can *"* go back 10 0,6 detect period 

to await the next asynchronous event. 

•fc have called this approach the -inhibited reset' approach. Fig 3a shows the basic riming for 
K r oin„ ^ event that occurs totally inside the detect period, and Fig 3b an event that 
^^r^S for the "inhibited reset'. The time for the detector to fire ,s 
Td, ^ TfSc probability of aqcuinng the asynchronous event without any corruption is _ 

Probability of success = (Tr-TdyTr and normally Tr » Td 

Note in both cases the effective exposure. Te3, seen by ail of the array and the detector is the 
full time of the stimuli, 

Te3 = Ts 

worse than the classic approach described earlier, 
ln.this case the effective exposure. Tc4. is 

Tc4 = Ts - Td 

ku a— in ooth te . r approach ^^^^f^^X 
detector, ie another opucal sensor thai s also ofindirec t detectors, are a vibration 

„ the case of the op,,,, detector U is ^^^^^X^ 
trigger it. 

I 
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anay, in such a way that the image array itself can act as the detector of the asynchronous stim- 
uli. This is because the array is already integrating during it's detect period, therefore by read- 
ing it before the decision to inhibit reset or not, you have a sample of the light that has been 
integrated by the array. By comparing these values with the values obtained when there has 
been no stimuli, we have a measure of the change. If this change is greater than a user defined 
threshold, then you can say that an asynchronous stimuli has occuxed. The choice of this thresh- 
old relative to the lowest energy stimuli it is desired to detect determines the effeciive time to 
detect Td in the following way. Fig 4. If Ts is the longest stimuli to cause saturation of the im- 
age sensor, Tsa is the time to read the sub-array, and Pt is the percentage of saturation that is 
required to trigger a threshold of detection, then the effective Td is 

Td = (Ts * Pt) + Tsa 

The major advantage or this approach is that the array itself is acting as the detector and is 
therefore in the focal plane of the focused image. Spatially distributing the sub-sample, greatly 
increases the probability that some of the pixels of the sub-sample are in areas wuh sufficient 
luminance. 

It is of course possible to use our described 'Inhibited reset approach* with a plurality of detec- 
tors and sub-sampled arrays, to determine if anasynchronous event has occurcd. 



Claims 

1) A means of operat ing a solid state image sensor for the acquisition of an image g eneratcd by 

an asynchronous stimuli, where said image sensor is operated in conjunction with at o*e 
■ detectors, detect the the said asynchronous stimuli by either direct or .ndirect 

c*;,i censor k regularly put into integration by releasing the an-ay from it s reset . 

^rlodT, Z :Z!c priorfo each ,e Se < detennining wheher U,Mre«t 
should be inhibited to prevent corruption of said stimuli. 

2) The use of a solid state image sensor for the acquisition of an image e" 6 "^ 
chronous stimuli were said image sensor is regularly being put into integration by releasing die 
£av Tom t V estate at a period Tr. where some portion of the array is read ipnor to , each 
rTse^dThe values of this «ead determine whether the subsequent reset should be inhibited to 
prevent corruption of s>aid stimuli. 
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As used herein the expression "asynchronous stimulus" mean6 a stimulus the timing of whose 
occurrence is not known in advance and which stimulus is associated with the presentation of 
an image to be captured lo the solid state image sensor. As discussed herein various kinds of 
solid stale image sensors known in the art may be used in the present invention, including 
5 CCD sensors as well as sensors such as those disclosed in our earlier patent publication 
WO91/04633, in which, following a resetting of the sensing cells, charge is built up on the 
sensing cells in response to incident radiation impinging thereon and the built up charge 
subsequently converted into a voltage 6ignal during an integration period, and this cycle 
repeated upon the next resetting of the sensing cells. In relation to the "continued integration 
10 period** it will be appreciated that this could be an extended period corresponding in effect to 
the inhibition of more than one reset pul6e i.e. a series of successive reset pulses. 

The present invention provides in one aspect an image capture control device suitable for use 
with a solid state image sensor for the acquisition of an image presented to the sensor in 

15 response to an asynchronous stimulus, said device comprising at least one detector means 
formed and arranged for detecting, in use of the device, directly or indirectly, a 6aid 
asynchronous stimulus, and reset inhibition control signal output means formed and arranged 
for generating a reset inhibition control signal in response to detection of said asynchronous 
stimulus and supplying it, directly or indirectly, in use of the device, lo a reset signal 

20 generating means operatively coupled to said solid state image sensor, so as to inhibit the 
application of at least one subsequent reset signal to the sensing cells. 

In a further aspect the present invention provides a camera having a solid state image sensor, 
wherein is provided an image capture control device of the present invention. 

25 
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